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ABSTRACT 


This thesis analyzes the dynamic response of a third order regulator sys- 
tem. Particular emphasis is placed upon the loss of stability of the nominal 
equilibrium state. The system utilized in this research models the funda- 
mental turning dynamics of an autonomous vehicle. We make extensive use 
of bifurcation theory methods in analyzing the dynamics after initial loss 
of stability. The effective gain of the system is used as the main bifurcation 
parameter, since this is directly related to the gain margin for linear systems. 
It is shown that the nonlinear characteristics of the system may significantly 
affect the practical significance of its gain margin, as a measure of robustness 


to parameter variations, unmodeled dynamics, and external disturbances. 
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I. INTRODUCTION 


A. PROBLEM STATEMENT 


It is well known that in linear dynamical systems one of the most popular 
ways of assessing the stability properties of the system is through its gain 
margin (Friedland, 1986). Roughly speaking, the gain margin designates the 
extent at which the effective gain of the system can be increased before loss of 
stability occurs. Therefore, it is widely used in linear control system design 
in order to quantify a measure of robustness of the system with regards to 


parameter variations, disturbances, and unmodelled dynamics. 


In this work we examine the concept of gain margin in the light of nonlin- 
ear systems. We assume that the baseline linear system is an approximation 
to a nonlinear system. For demonstration purposes we employ a third order, 
single input single output system, with cubic nonlinearities. This system 
models the fundamental turning dynamics of a marine vehicle (Oral, 1993). 
Primary loss of stability is shown to occur in the form of generic bifurca- 
tions to periodic solutions (Guckenheimer & Holmes, 1983). We use center 
manifold reduction techniques and integral averaging in order to capture the 
stability properties of the resulting limit cycles (Chow & Mallet-Paret, 1977). 
The main conclusion of this work is that the linear concept of a gain margin 
can be used as a reliable measure of stability only in the case of supercritical 


bifurcations to periodic solutions. In the case of subcritical bifurcations, a 


modification is necessary which is based on the nonlinear characteristics of 
the system. We propose the use of a parameter which governs transitions 
from supercritical to subcritical bifurcations as a nonlinear gain margin of 
the system. Results based on numerical simulations support the analytical 


predictions of this work. 


B. MATHEMATICAL MODEL 


Consider the ideal 3rd—order regulator system shown in Figure 1, where 
y is the actual output, y,.-¢ = 0 is the reference input, and, 


1 


A) = SF age tae tay’ 


(1) 


where the coefficients a; correspond to a stable polynomial. In state space 


form, the system depicted in Figure 1 is written as, 


Zy = 2, (2) 
Zo = 23 ’ (3) 
23 = —A297%3 — A722 — (Qo + K)z, 3 (4) 


where the state vector is, 
%1=Y7, TZ. =Y, wy=y. (5) 
Physically, we can think of this system as a representation of the funda- 


mental turning dynamics of a marine vehicle. In this context, z; represents 


the vehicle’s lateral deviation from the commanded straight line path, x is 





Figure 1: Ideal 3rd—order regulator system 


the orientation angle, and z3 the turning rate. To account for the geometric 


nonlinearities, the first state equation (2) is written as, 
%, =a, +723, (6) 


where y < 0 for softening spring characteristics. To account for possible 
“over—steering” or “under-steering” effects, we modify the output of the 


block K of Figure 1, to 
control effort = —Ky — Kay’ , (7) 


instead of —K y of the linear element. Therefore, the nonlinear system under 


consideration is, 


Ly 0 1 0 ry yz} 
£2 = 0 0 1 2 + 0 (8) 
Ly —(a + K) me = Xp 3 —K32? 


C. OUTLINE OF ANALYSIS 


The following steps are performed in order to analyze system (8). First, 
application of Routh’s criterion yields the value of the gain margin, or the 
critical value of K for stability. Then we rewrite the system of equations in its 
normal coordinate form, and use the center manifold theorem to reduce the 
system into a two dimensional system. We apply the method of averaging 
to the reduced system, and finally, we introduce polar coordinates to the 
averaged system in order to reveal the existence of limit cycles. Development 


of these computations is the subject of the next chapter. 


Hl. ANALYSIS 


A. LOSS OF STABILITY 
The characteristic equation of (8) is, 
si+a.s?+a,s+(a9+K)=0. (9) 


Application of Routh’s criterion to system (9) yields the critical value of K, 


K,, for stability of 2; = z2 = 23 = 0, 
K. = a1 02 — &% . (10) 


If K < K, the system is stable, whereas for K > K, it becomes unstable. 
The value of K,, given in equation (10), expressed in decibels represents the 


gain margin of the system. 
At the critical point, K = a,a2 — a», the characteristic equation (9) is, 
s+a,s’? +a,s+a,a,=0, 


which has roots, 


=a Qt, 
8a = +./a3t 3 (11) 


83 = —-@&. 


$3 


Therefore, we can see that the above loss of stability is characterized by the 
existence of a pair of purely imaginary roots. As K crosses K,, one pair of 


complex conjugate roots of (9) crosses transversally the imaginary axis. 
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A situation like this in which a certain parameter is varied such that 
the real part of one pair of complex conjugate eigenvalues of the linearized 
system matrix crosses zero, results in the system leaving its steady state 
in an oscillatory manner. This loss of stability is called Hopf bifurcation 
(Guckenheimer & Holmes, 1983) and generically occurs in one of two ways, 
supercritical or subcritical. In the supercritical case, stable limit cycles are 
aanereiee after the nominal straight line motion loses its stability. The am- 
plitudes of these limit cycles are continuously increasing as the parameter 
distance from its critical value is increased. For small values of this critical- 
ity distance the resulting limit cycle is of small amplitude and differs little 
from the initial nominal state. In the subcritical case, however, stable limit 
cycles are generated before the nominal state loses its stability. Therefore, 
depending on the initial conditions it is possible to diverge away from the 
nominal straight line path and converge towards a limit cycle even before the 
nominal motion loses its stability. This means that in the subcritical Hopf 
bifurcation case the domain of attraction of the nominal state is decreasing 
and in fact it shrinks to zero as the critical point is approached. Random 
external disturbances of sufficient magnitude can throw the vehicle off to an 
oscillatory steady state even though the nominal state may still remain sta- 
ble. After the nominal state becomes unstable, a discontinuous increase in 
the magnitude of motions is observed as there exist no simple stable nearby 
attractors for the vehicle trajectory to converge to. Distinction between these 


two qualitatively different types of bifurcation is, therefore, essential in the 


design of the autopilot. The computational procedure requires examination 
of the higher order terms in the equations of motion and it is the subject of 


the next section. 


B. COORDINATE TRANSFORMATIONS 
System (8) is written in the form, 

x = Ax + g(x), (12) 
where A is the linearized system matrix and g(x) contains the cubic terms. 
At the bifurcation point K = K,, matrix A has eigenvalues given by (11), 
and eigenvectors, 


T= 


1 —-Q2 


0 —/ aa 


By taking T to be the matrix of critical eigenvectors of A, the transformation, 


(13) 





0 1//fa; «| 
0 


x=Tz, z2z=T'x, (14) 


transforms system (12) into its normal coordinate form, 








z= T'ATz+T'¢g(Tz), (15) 
where, 
1 M0 ata a, 
t= 5 | Waa} 0 — fa | , (16) 
1 ar 2 a) 0 1 
and, 
0 —4/Q 0 
T1aAT=|/a 0 0 (17) 
0 0 —Q2 





For values of K close to the bifurcation point K,, the matrix T~!AT 


becomes, 
ale —(,/a; + we) 0 
TI IAT =| /ay tue ale 0 . 
0 0 —a,+p'e 
where € denotes the criticality difference, 
e=K-K,, (19) 


and a’ is the detentre of the real part of the critical eigenvalues with respect 
to €, w’ is the derivative of the imaginary part of the critical eigenvalues with 
respect to €, and p’ is the derivative of the third eigenvalue s3 with respect 
to «. These are computed using a perturbation series approach as follows. 


The characteristic equation (9) can be written in the form, 
s* +028? +a,;8+(a,0, +e) =0, (20) 


where we have used (10) and (19). The roots of (20) are expressed as, 


$s = ae—-(fatu'e)i, — (21) 
82 = aet(Jfat+u’'e)i, (22) 
$3 = —@2 + ple ° (23) 


If we substitute (21) through (23) in (20) and neglect terms of order ¢’, e°, 





we get, 

1 
i=: —— 24 
' 2(a, + a2)’ i) 

t a2 

YS - az 25 
2,/a1 (a, +03)’ (25) 

1 
f= — ; 26 
P oe (26) 


C. REDUCTION OF ORDER 


The physical variables z; are related to the normal coordinates z through 


(14), and using (13) we get, 


%) = Wa + 2%, 
Z2 = 2, — A223 ) (27) 
3 = —V/ 2+ 08 23 : 


It can be seen from (26) that p < 0, and therefore the eigenvalue s3 is 
locally (for € small) negative, as shown in equation (23). In fact, a quick 
root locus plot of (9) will show that ss is negative for all values of K > 
0. Therefore, the flow of (8) in the direction of z3; converges to zero. All 
interesting bifurcation phenomena are locally restricted on a two dimensional 
manifold that decsribes the time evolution of the critical coordinates 2, 22; 
this is the center manifold of (8). According to the center manifold theorem 
(Guckenheimer & Holmes, 1983), the stable coordinate z, can be expressed 
a a function of the critical coordinates z,, z2, and this relationship is at least 
of quadratic order. In fact due to the symmetry in our problem, the above 
relationship is of third order. Therefore, z3 does not affect the nonlinear 


terms in (15) and we can write (27) in the form, 


1 
om 22 4 


ZT2 = 24; (28) 


73 = —-V¥%%- 


zt) = 


Using (28) we can write, 











23 
g(Tz) = 0 
—K323 /a;" 
and, 
01 0223 — K3z3a2/a>"” 
T 'g(Tz) = 5 | Venogyzit Ksy/o, |. (29) 


O72} a Ky23 ai” 
Using equations (18) and (29) we substitute in (15) and write the normal 


equations in 2, 22 as, 





zy = al ez, — (Jo + w'é)z2 + F, (21, 22) 9 (30) 
22 = (fo + w'e)z, + a! Ez + F,(“, 22) 3 (31) 
where, 

1&2 3 a2 3 

Fy (21, z = eyez) — — — TK 32 
Yue 3 3 

Fi(z:,22) = Sh ee el 33 
2 (21 22) Oy + a2 171 (a, we a oxy 3“2 ( ) 


Equations (30) and (31) describe the suspended center manifold flow of (15) 
(Guckenheimer & Holmes, 1983). 


D. AVERAGING 


If we introduce polar coordinates in the form, 


z=Reos?, »=Rsiné, (34) 
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we can write equations (30), (31) as, 


R = a'cR+ F(Roos 8, R sin 8) cos 0 
+F,(R cos 6, R sin 8) sin 6 , (35) 
RO = (fo, +w'e)R + F(R cos 4, R sin 8) cos 8 


—F,(Rcos 6, Rsin 6) sin @ . (36) 
Equation (35) is written in the form, 
R=o'cR+P(6)R° , (37) 


where the function P(@) is 2x—periodic in the angular coordinate @, 


n= ——s 6 — ———_—_—_ K. 7] 6 
P( ) am le a * aos? 3 cos @ sin 
2 
/ Ot & , t , 
Fa ag or Oat Se pay ene: (88) 


If equation (37) is averaged over one cycle in 0, we get an equation with 
constant coefficients, 
R=a'cR+QR°, (39) 
where 
: “p 6) dé 
Q=5- [Po a0. (40) 
Substituting (38) into (40) and evaluating the integral yields, 


ajar + Ks 


a (a a3, az) 


3 
Q=5° (41) 


Similar averaging can be performed for equation (36) which has the form, 


6 = fa; twee +F(0)R? , (42) 
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where -- 


a/ Ay & 1 - 3 
F(6) = 494 ———__—_K. (7 7] 
(6) o La VOCE 1 cos ao en 3 cos @ sin 
1 A a2 
————*~~7 cos* @ sin 6 + K3 sin‘ 6 , 
EY ae 2 a ay!*(a + + a3) ° 


and we have assumed R #0. The averaged form of (42) is, 
@= /a, + ae On ' 


where 
1 2 
== [ F(6) dé , 


and using (43), 
3a2 a? a2y — Ks 


G= 
8 of!? (ar, + a2) 


(43) 


(44) 


(45) 


(46) 


The system of equations (39) and (44) exhibits similar stability properties 


to the original system (37) and (42) (Chow & Mallet-Paret, 1977), and is 


studied in the following section. 


E. LIMIT CYCLE ANALYSIS 


Equation (39) has two steady state solutions, one at R = 0 which corre- 


sponds to the trivial equilibrium solution at zero, and one at 


R=—Se. 


(47) 


This equilibrium solution corresponds to a periodic solution or limit cycle 


in the cartesian coordinates z,, z. from (64). Since a’ as seen by (24) is 
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always. positive, existence of these periodic solutions depends on the value of 
Q. Specifically, 
e if O <0, periodic solutions exist fore > 0 or K > K,, and 


e if O > 0, periodic solutions exist fore < O0or K < Kg. 


The Floquét exponent of (39) in the vicinity of (47) is 
B =-2a'e, (48) 


and we can see that 


e if periodic solutions exist for K > K, they are stable, and 


e if periodic solutions exist for K < K, they are unstable. 


We refer to the first case as the supercritical Poincaré-Andronov—Hopf (PAH) 
bifurcation and to the second case as the subcritical PAH bifurcation (Guck- 


enheimer & Holmes, 1983). 


The period of these limit cycles is computed by substituting (47) in (44), 


=o Qn -=( _wWQ—-alG 
fer twe+GRR Va Va 2 


The amplitude of the limit cycles is computed from (47) and (28), and in 


.) +O(e?). (49) 


terms of the physical variables 21, 22, 23, we get, 
3 —a,—K 
= v3 ao (50) 
3 ay Ao + K3 
= V3 | a1 (a102 — a — K) (51) 
3 ogasy + K3 
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V3 fora,-ao-K 
zr3 = aay atagyt+ Ky (52) 


We can see that in the supercritical case, on loss of stability of equilibrium 
the steady state becomes a periodic oscillatory state, the amplitude of the 
oscillation being proportional to the square root of the criticality c, the differ- 
ence of the gain K from its critical value K, at which stability of equilibrium 
is lost. This form of loss of stability is called “soft” loss of stability since 
the oscillating state for small « differs little from the equilibrium state. In 
the subcritical case, before the steady state loses stability the domain of 
attraction becomes very smal] as is bounded by the amplitudes of the un- 
stable limit cycles, and a random disturbance can throw the system off its 
equilibrium state even before its domain of attraction has completely disap- 
peared. This form of loss of stability is called “hard”. Here the system leaves 
its steady state with a jump to a different state of motion which can be a 
stable oscillation with a locally discontinuous increase in the amplitude, a 
more complicated bounded motion, or even an unbounded a8 depending 
on other higher-than-third order terms that have not been incorporated in 


system (8). 
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II. RESULTS AND DISCUSSION 


A. RESULTS 


For demonstration purposes we assume that in the case K = 0 the system 
has been designed in accordance to the ITAE optimal criterion for third order 


systems; i.e., 


Q2 = 1.7ow, 
n= 2.15w? ; (53) 
a = ws ’ 


where the natural frequency w,, is in general selected according to the desired 
bandwidth of the system. The ITAE criterion is a standard performance 
index and it minimizes the integral time absolute error {5° tle(t)| dt, of the 
step response e(t) of a system (Dorf, 1992). This criterion is satisfied for 
a third order system when the coefficients of its characteristic equation are 
selected as in equations (53). The critical value of K for stability is computed 
by, 

K, = 002 — ao = 2.7625w> . (54) 
A graphical representation of equation (54) is shown in Figure 2 for a nominal 


range of w, between 1 and 2 rad/sec. 


The cubic coefficient Q that dictates the nature (supercritical or subcrit- 


ical) and stability of the resulting limit cycles as K exceeds K; is given by 


15 





>: | 


Wn 


Figure 2: Critical value K, versus w,, 





Wn 


—5 and different values of 7 


3 


fficient Q versus w,, for A 


Cubic coe 


e 
'° 
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Figure 
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(41), and using (53) we get, 
Ks 
O = 0.2707wry + 0.01127 (55) 
A plot of equation (55) for A; = —5 and four different values of 7 is shown 


in Figure 3. 


Based on the results presented in Figure 3, the following observations can 
be made: (1) For fixed Kgs and a given value of w,, supercritical bifurca- 
tions are ensured for a value of 7 less than a critical threshold, computed by 
equating Q = 0. (2) In the case of supercritical bifurcations, we expect to see 
an oscillatory response approaching zero when K < K, and converging to a 
periodic solution for K > K,. The above response should be independent of 
the initial conditions, at least locally. (3) In the case of subcritical bifurca- 
tions, we expect to see an oscillatory response for K < K,. which may or may 
not converge to zero. This depends on the initial conditions. If the response 
diverges from zero, the final attractor can be another oscillation or a more 
complicated motion. The same is true for K > K,, here the response should 
diverge regardless of the initial conditions. These conclusions are confirmed 


in the next section using direct numerical integrations of equations (8). 


B. NUMERICAL SIMULATIONS 


An example of supercritical behavior is shown in Figures 4 and 5. In both 


of these figures we present results based on direct numerical integrations of 
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equations (8) for the following conditions, 
w,=2, K=1.05K., K3=-5, y=-0.1. (56) 


For these conditions, which are selected to demonstrate the supercritical case, 
we can see from Figure 3 that Q < 0 and, therefore, we have a supercritical 
Hopf bifurcation. Figure 4 shows clearly the development of a stable periodic 
solution with amplitude z. = 0.68 and period T = 2.14. The theoretical 
value for the limit cycle amplitude is computed from (56) and (51), as zz = 
0.6405 which is in excellent agreement with the numerical value. Likewise, 
the period of oscillation is found from (56) and (49), as T = 2.1351 which is 
also close to the actual period. Figure 5 shows the convergence to the limit 
cycle in the (z2,22) phase subspace using two sets of initial conditions. One 
set (21,22,23) = (0,0.5,0) is located inside the limit cycle and the other set 
(21,22,23) = (0,1,0) is located outside the limit cycle. It can be seen that 


both trajectories converge to the, numerically computed, periodic solution. 


An example of subcritical behavior for K > K, is shown in Figures 6 and 
7. In both of these figures the conditions were the same as (56) with the 
exception of which was y = 0.2 for Figure 6 and 7 = 0.1 for Figure .7. 
These correspond to Q > 0 as can be seen from Figure 3, which confirms the 
subcritical behavior. The motion which corresponds to y = 0.2 is strongly 
subcritical and it becomes unbounded shortly after 20 seconds. The motion 
which corresponds to y = 0.1 is less subcritical since it yields a smaller, but 


still positive, value for Q. As seen in Figure 7, it appears that trajectories 
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x2 





Figure 4: Time history (t,z2) for w, = 2, K = 1.05K., K3 = —5, and 7 = -0.1 


x2 dot 





x2 


Figure 5: Phase subspace plot (2,22) for w, = 2, K = 1.05K., K3 = —5, y = —-0.1, 
and two initial conditions 


is) 


x2 





Figure 6: Time history (t,z2) for w, = 2, K = 1.05K., K3 = —5, and y = 0.2 
converge to a relaxation oscillation of high amplitude. 


An example of subcritical behavior for K < K, is shown in Figures 8 and 


9, for the following conditions, 
wy, =2, K=O095K., Ky = Sap 02), (57) 


and different initial conditions in x2. For small initial conditions, (z,,72,23) = 
(0,0.1,0), the system is located inside the unstable limit cycle and it con- 
verges to the stable equilibrium, as shown in Figure 8. However, for large 
initial conditions, (z;,22,%3) = (0,0.5,0), the system trajectory is located 
outside the unstable limit cycle and it diverges away from the equilibrium, 
even though this equilibrium is still stable. It appears from Figure 9 that, for 


small -, the system converges to a relaxation oscillation, while higher value 
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x2 dot 





Figure 7: Phase subspace plot (z2,Z2) for wy, = 2, K = 1.05K., K3 = —5, and 
Ja evok 


of + generate more severe subcritical behavior and the motion becomes un- 
bounded, as before. In the case of supercritical behavior and for Ore Eve, 
we observed that numerical integrations converged to the stable equilibrium 


regardless of the initial condition in z2, as they should. 


C. MULTIPLE EQUILIBRIUM STATES 


So far, our analysis has been on stability properties of the trivial equilib- 
rium of (8), and its bifurcations to periodic solutions. It is possible, however, 


that additional equilibrium points may exist. To explore this, we write sys- 
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Figure 8: Time history (t,z2) for wy, = 2, A 
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Figure 9: Time history (t,z2) for w, 
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Figure 10: Steady state solutions X, versus Kz for K = 0.95K., y = 0, and three 
values of w, 


tem (8) in the form, 


Ly = + x3 ’ (58) 
Lo = 3, (59) 
Ly = —(ag + K)zx; — @%2 — Ag®3 — k32? . (60) 


In order to compute its equilibrium points we must set the time derivatives 
£1, £2, £3 zero, and solve for the equilibrium point X,, X2, X3. We examine 


the case y > 0 first. 


Equation (58) yields, 
X, + 7X} =0, (61) 
which, since y > 0, has only one solution, namely X, = 0. Equation (59) 
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Figure 11: Time history (t, 2) for w, = 2, K = 0.95K,., K3 = —5, y = 0, and two 
initial conditions in 2 


gives X3 = 0, and then (60) can be solved for the remaining equilibrium 


solution X), 


X (ap + K + K3X?) = 0. (62) 


Equation (62) admits the trivial solution, X, = 0, always, and two more 


possible solutions provided K3 < 0, given by, 


+K 
yo : 
1 ee (63) 





Equation (63) yields two additional symmetrically located equilibrium points 
which are generated as If; becomes negative. A typical plot for K = 0.95K, 
and three values of w, = 1, 1.5, 2 is presented in Figure 10. Therefore, we see 


that the same coefficient, K3, which governs the transition from subcnitical 
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to supercritical bifurcations to periodic solutions of the trivial equilibrium 


state, is also associated with the existence of additional equilibrium states. 


In order to analyze the stability properties of these solutions we linearize 
equations (58) through (60) in the neighborhood of X;. If we denote by €; the 
deviation of z; from equilibrium; i.e, é; = z; —X;, we can write the linearized 


system as, 


& = E> ’ 
bs = Es ’ (64) 
é = —(ao + K)b — af — arés — 3K3X7& . 


If we substitute (63) in (64) we get, 


é = E> ’ 
bs = Es 9 (65) 
fs = 2ao+ K)br — arb: — ars - 


The characteristic equation of (65) is, 
s* + a2s’ +0,5 —2Aao+K)=0, (66) 


which means that the additional non-trivial equilibria are clearly unstable 
with divergent dynamics. Therefore, the case Kz < 0 which was shown to 
be beneficial from the point of view of Hopf bifurcations, is undesirable from 
the point of view of static bifurcations. The final compromise depends of 


course on the particular demands and specifications of the design. Figure 11 
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Figure 12: Steady state solutions X, versus K3 for K = 0.95K., 7 = —0.1, wy, = 2, 


demonstrates the divergent properties of the additional equilibrium states 
for K3 < 0. Two numerical simulations (t,2,) are shown for Ky = —5, 
w, = 2, and K = 0.954,, and for two sets of initial conditions, (1,722,273) = 
(2.40,0,0) and (21,272,273) = (2.41,0,0). The unstable equilibrium X; is 
located at 2.408 as predicted by (63). We can see that, as expected, numerical 
simulations inside the stable potential well, 2, < X,, converge to zero while 


those outside, 1; > X,, diverge and quickly become unbounded. 


The case - < 0 can be analyzed similarly. Equation (61) admits in this 


case the trivial solution X, = 0 which was analyzed previously, and two more 
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Figure 13: Degree of stability of the lower outer solutions which appear in Figure 
12 
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Figure 14: Trajectories for (3 = —4.6 and two different initial conditions; variables 
correspond to Figure 12 
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symmetrically located solutions, 


X?=—-. (67) 
zi 


Then X3 = 0 while X, is obtained from (60) as the solution to, 
(a — K)X, + a, X2 + K3X? = Qu (68) 


A typical solution set of (68) is presented in Figure 12 for wu, = 2, K = 
0.95K., and 7 = —0.1 with X, given from (67). If we compare this to the 
corresponding solutions for ~ = 0 shown in Figure 10 we can observe that 
the nontrivial solutions for ~ = 0 retain their shape, these are denoted by 
outer in Figure 12. The main difference here is the existence of two outer 
solutions for most of the range of K3. The trivial solution X, = 0 of Figure 
10 perturbs in this case into the solution labeled as inner in Figure 12. It 
can also be observed that there is a point, in this case at about K3 = —4.8 
where the lower outer solution coalesces with the inner solution. For values 


of Kg less than this critical point only the upper outer solution remains. 


Stability properties of these solutions can be established by linearization. 
The linearized system of (58) through (60) for X, # 0 takes the form, 


& = —2€, ’ 
ae (69) 
és = —-(ao+K+ 3K3X7 )é — ay f2 — args . 


The characteristic equation of (69) is, 


so + ars’ + a,8 —2(ay + K + 3K3X?) . (70) 
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Numerical computation of the roots of (70) revealed that both the inner solu- 
tion and the upper outer solutions were unstable. The lower inner solution is 
initially stable, in other words the point where the lower outer and the inner 
solutions of Figure 12 meet is a saddle—node point. The degree of stability 
of the lower outer solution, defined as the largest real part of the three roots 
of (70), is plotted in Figure 13 versus K3. This corresponds to a complex 
conjugate root. We can see that it is initially stable and that it undergoes a 


Hopf bifurcation at a value of K3 approximately —4.15. 


These results are confirmed by the numerical integrations presented in 
Figures 14 through 16. For K3 = —4.6, the lower outer equilibrium solution 
is stable. Therefore, the numerical simulations will converge to either this 
solution or the trivial equilibrium depending on the initial conditions, see 
Figure 14. The trivial equilibrium is a rather weak attractor in this case 
since K is very near its critical value K.. For K3 = —3, the lower outer 
equilibrium point has become unstable and is surrounded by a stable limit 
cycle. Depending on the initial conditions, trajectories will converge to either 
the stable trivial equilibrium or one of the two stable limit cycles, see Figure 
15. Apparently there exists a region where the final outcome is sensitive 
to the choice of initial conditions, and the corresponding transient response 
resembles a random pre—chaotic motion before the trajectories converge to 
the corresponding attractor. This limit cycle persists as K exceeds K,, see 
Figure 16. In this case the trajectories will converge to either the trivial or 


the non-trivial limit cycles, depending again on the initial conditions. 
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-IV. CONCLUSIONS AND RECOMMENDATIONS 


This work presented a methodology for assessing the dynamic response of 
a third order system with respect to changes in its gain. Choice for the 
baseline system was motivated by modeling the fundamental dynamics of an 
autonomous vehicle. The methods, however, are of general nature and can 
be applied to any given system. An extensive study of the dynamic loss of 
stability was performed based on Hopf bifurcation theory techniques. The 
existence of both subcritical and supercritical bifurcations to periodic solu- 
tions was established depending on the system parameters. It was shown that 
the critical system gain for stability is useful for design purposes only to the 
extent that it is accompanied by supercritical bifurcations. The latter can be 
studied using a comprehensive nonlinear study like the one presented in this 
work. Future work should concentrate on classifying the nonlinear dynamics 
of various dynamical systems in terms of their order and linear/nonlinear 
properties. Such a generalization could allow the establishment of a more 
reliable set of measures than the linear gain margin, which would be used in 


control system design. 
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